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(54) APPARATUS AND METHOD FOR IMAGE PROCESSING 

(57)Abstract- 

PROBLEM TO BE SOLVED: To precisely detect the 
movement direction of a CCD camera by computing a 
direction in which an extracted feature point is moved 
from an optical flow. 

SOLUTION: Light which is reflected by a reflecting 
mirror 1 used to reflect light in the up-and-down 
direction and the right-and-left direction with reference 
to the optical axis of a CCD camera 2 and light which is 
transmitted through the central part of the reflecting 
mirror 1 are incident on the CCD camera 2. A front- 
image extraction part 3-1 p an uppeHmage extraction 
part 3-2, a loweHmage extraction part 3*3, a left-image 
extraction part 3-4 and a right-image extraction part 3- 
5 extract the light transmitted through a transmission 
part in the central part of the reflecting mirror on the 
basis of an image which is output from the CCD camera 
2, or they extract images corresponding to light reflected 
by reflecting mirrors 1-1 to 1-4 in the up-and-down 
direction and the right-and-left direction so as to be 

supplied respectively to feature-point extraction parts 4-1 to 4-5. The feature-point extraction 
part 4-1 to 4-5 extract feature points in the respective images so as to be supplied to optical- 
flow computing parts 5-1 to 5-5. The opticaHflow computing parts 5-1 to 5-5 compute the 
movement of the feature points by referring to their front or rear frame, and the movement 
direction of the images is estimated. A movement-direction judgment part 6 judges the 
movement direction of the CCD camera 2 on the basis of the movement direction of the 
feature points computed by the opticaHflow computing parts 5-1 to 5-5. 
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(54) [RW>€*] (S*«ia«**±OW<M!yi*tt 



(57) [C»] 

[Big) CCD^T^&Sj^fiiHfcttiT*. 

«P*»**BLfc*tt, CCD*>9 2l£A*t*ft*. 
(MF, tfctt, ±T£££IifcfaitiSIS3- 175S3-5 
tt, CCD*j<?2;»>6tt*;dlifcBftJ:9. 

S»a 1 - 1 7bm 1 - 4 K «t 9 fi»*itfc*t»lt+6 

JUfefSTS, W»jftttlH«4-l75S4-5tt. *Jx-e 

noMtattKAfrifeiuu ^■7'7 i ^*/u7D-»tagi5 

SB 5- ift£5-5ii. #t^ol»S£*roflr*fctt« 

- 1 5 - 5 K «t 0 Wtt£ftfctt|ft&ro9tt#A)fc J: 
9, CCD*^7 2W»K)*l6]$r|i]!e-r5„ 
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(2) 

1 

tottJ^at. 10 

meat i & 2 ©«ai*g«c 1 9 jam $ tnzmm 
a. 

HtM^Tfc*), 20 

6aa»«:ailLfclllE**l*|4j«)*i, iftE4ft«>¥ 
®*lwJ:>)5W$nfc. fflEifc«ilc*tL-C±Tfc&:fr|6] 
<D5*t3fci: «rAft1-S 1 fc tSifrfcJg l lcE« 

*>■*&■*■. 

Iff 3 ] JJrSo|Wfc#i-S»fll^^y^i:. 
tot Ztm^f Vfl. 

IWaB*^f-s'7'A'f)lB**ii6ffl*ft*W5*.. Mffi 30 
3tl**|fi|K#i£:-*-5S(fc«*«r»ai1-5» 1 wtttH^x 

r» * r y ra> b © a e *ra?i- 5 Hftm * tea* 

tfJEfc 1 *s i 2 r y i. <0 mm £ ixfc® 

■ft. 

=r 4-hiV7u-fr<b, WEStfe*?? LT^* 40 

[*9!4>l*tt4Ktil 
[000 1] 

uqHft&ffi*felcHL. £fii*<*>£*);frl»i£fc 
ttH-5 r t d^f£4Bfc&SfSttfc.t tmffei&S#ifcl£ 
BB1-5. 

[000 2] 
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[0 0 0 3] fc*|CJ3V>T. ZnHoKSttOatf? 

yfiifva. man. o* y hwitfr^i&iroB&fccc 

JfcttiLfcd, #»^©^r^*^7n- (Optical F] 
[0004] 

[32W>W^LJ;?i:-f53SJB] W»UM*6, CWJ; 
ft) Lfc^wWuoS^lcfcvvCfc. fi»£ii,*B{fe 

[0 0 0 5] M*eJ:3fcU*JIHfci-Sfcfclc 
**OiB««)»ft*l«W»6ojKy hi* 

P>, CWiSfc^Src-li, «*©CCD*^5a»*Kfc 
ftfio-c. 3*h:MS<o<£v*5R»S*#>ofc. 
[0006] #S9!(±, «±© J: 5 4#Rfc**T44 
ftfcfccDTfciJ, WfttrfflfriEBlc, L4>MHLfc*<I] 
1-5 r t SBft&S&ESr&a * I 

[000 7] 

[SSIrJ!?^i-5fcftc7)^gJ l lOBttoBftfe 

tS»W3t«*|6)tliJI4i, '>4<it>l*iai©ft*R 
StLT. «(ft#©lCAW1-5Slt#ai, 

tttw+switsiiiia^afc . #m^.tta#aic i 9 u 

[0 0 0 8] Sf*JS3liE«^ilfi!«iS*)!£li> Bf*w 

H#rtttt*46. '>4<it>l36ri6J©Jfc«:RWL-C. 
«t^Ty^KAW+6K«*^v/i, fitter 

&ff#Sr«)ffii--5«l(0«)ffl^7 L .yyi:. Jttfe^^yT' 



3 

7k, ¥iWi&&XTy7K£*)miSMzmm* 

r6)«r»mt5»m^T y 7k c k zmt + 

3, 

[0009] i £&%<ow&&mmmz*$^x 

RltUT. fifc^SlcAftU »{MMito>e>lii7>$*v3 

isttift^© 5 mtfakmtzm&mzn i © 

*7T4*rV7a-frb. 18tfe^f!:ro#E!jLT^3£|S] 

ccd*^wj:5i: 

4 ttOKMBAfftBCBtt <bixfci§i§g6$:)Si& Lfcft 
B#l«W>3fc«:A»U Bl©ttffl*Btt, igi§S&$:i§i@ 
lfcX(cttffrr«BB*BBiU B2»tttH#«Ht. 4 

3®«fc**i«ittaju ®mtommi> bus* 
loo i oi is*«3icta«(Dii«j&a^&ic^v^T 

tt. B«*7y7'ttB*OHlF**U «Hfe*f'v7V> 

^y^fetHflanSBBflr*©^, £M£AIC&£ 
tSBBWKBlOttW^s^BtBU 
y7*»&ffl#a4i5BB»*©5*>. BMx?v7*b 

fflU Bi*J:ifB2©ttlii*?y7liJ:9ttiaSJifc 

BB«4K>*ft«x<&WA*»Bjftitttti** **wb 

JUL. B«ifttta;*?y:rtcj:9*ai$*ifcBBA©* 
7*4**7n-a»&. BB^yT'WfMftLTV'ft* 

i?tC0f«oaif«rt1-5»«^T-yyiC«LT, B£ 

48cWRW»ri>ibfc3Rtt*T y^*tMfftRWLX 
Alti-ftfcitlc 4fe<0RW«o**»l<:Ktt<bftfc 
SBB*aBLfc*IWM(l©**:AWL, SBlwttfcb* 

U B20tttHa??:?u. 4ttWglt«tlCi*3gWS 



(3) ftPWl 0-2 6 7 95 5 
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*lfc£ft 5 ft WBt&©#aj£©:fr77 1 •< * A-V a -jj >f, 
m*? 9 7V)BB*G*»lBt*. 
100 1 1] 

WB©BB«>»»] 0 1 IS, *8?f]<D£i6©J&1l8<D* 
*«**+^oy*H-e*>5. z<n®£t*^x, rwb 
10 l (5lt¥ft) tt» B2WJEKHK*tJ:5lc, 4 ft© 

b«b«>¥sb {±*Bi«ffl« i - i „ rm&m 1 

-2, fefr|Sjffl&l-3, fc«tlA t*A«Bl-4) 
0±ES5^CCD*p<7 2 (»ft#ft) K»flS*3* 
1 t> fc» *©EI!Bi4**B*:fi < K*4i«i©»a 
BtrttEfcBB **T»fi***i*> 9. CCD;M7 27>> 
feB*©E*£tf*fcfcttBfcB:£SnTP6. Bt>. 
i*ie>4ft©Btt. -&jgwTffi* 5 ±J£J: 9 t>lftii©&© 
*K*6i9KEB**iT*J9. «BO±*fla»bBB 
dMWKirfta. ztxb4ft<omi. CC 
20 D#y 7^ ©#!*£# LT±T£*;frfl©jfc«:RWl, 
■C, CCD*>9 2lcAW1-5J:5lc4$ii-CV'6. * 
fc, to^MMcttit&iixv^SBA (EBBi-i 
»Sl-4«±B«:4iat'+5aaa) li, JtB*l6l«) 
3tS:Si§L-CCCD*^72jrA«-f« J: 7^*$ffC 
V*3. 

[0 0 12] 13311. R«ftl-l75Sl-4£CCD 
ayT^fcwffiBBBttKW+SH-c**. zamzw 

•Ti^lC. RW»l-lW5l-4Ht. CCDA^72 
©B*lcEBSivC:i39. B4fc*1M:3fc, CCD* 
30 >7 2©*Bfc»LT±Tfe6#l»l©Jfc*RWLTCC 

Bl - 1 75M 1 - 4co£jggI5$r4a<!:-r5Si@IP/)>'b 
tt, CCD#>7 2©#*i#|6)©3fc* J A*taFft3. 
[00 13] wWJ:9l«:LTCCD*^7 2ICAW$H 

511, CCD*^7 2A»5>ai^*ixSB*ro-W^*i- 

Bffcs. ;oBics«-f-J:5e. ccD*^7 2^e.ia 
^$n5®»ii, R«»i-i7>si-4fl>«i>*©aB 

6S«:SiiLfcW^B«. gjHBl-Hw«tOSH$nt 
40 ±#0(8. 5WBl-2lc«t9RW$nfcT*l«. R 
5tBl-3lc«t»?SW$iifc&*ii«. RWB 
l - 4 ic J: 0 SW * n/i**ii«!©«^®ft-Cfo 3. 

too i 4) w*H«ttma53-i (BirottmB) 

tt, BSK^im^BB (K«B©«t»*feB»Lfcftlc 

±*H«ttma53-2 (B2oBtUB) li. RWBi- 
1 (wj: 9R«t$nfc*lw»l£:i-3BB«:ttai-f 3 X *> \z 
tt$*iTTV>3. BBirL-C, T*B«ttUSB3-3 
(^2<OfttilSi5) . £^®(6»fflSB3-4 (I20fi6t« 
50 B) . *fett. **Btt!ttaigC3-5 (3?2<OttltiiSS) 
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11, -eii€iv. K#«l-2 75£i-4lcJ:*>EW$ii 

10015] mmm4 -mm* -5 (mm 
m^a) 14. na. J3«tt;, ±Tfe**i6]<oB«ttus3 

- 1 755 3 - 5 lc4 Qtttfld JifcBftfB9fl><bjft£rott 
(«*tf, BBBiWBBaiclt^Ta^Bfct 

[0016] ^7 , r^*^7n-||tiJg55-175S5- 

5 mmm 14. msteajsn-iB^-sici 

L<tt«/M>*rB, *fctt, *tt<l4S*|6)O@IE(0 

[0017] mumms (5im*e) ». *t*t 

4 **7n-JUH»5— 1 ft£5-5IU9SW£iifc 
-f*/U7n-fr^U-C, CCD*^72»#ft 
^Btrflfc-*-* J: 5 Sim ' 5. 
[0 0 18] fcfc. Slt©BB«>»B©iM1M;:oivCK 

[0 0 19] V**. Blt*+*ISO»to«a!fen#y 
h (KIT. nstfyhilgBi-a) W^W^ICSS* 

[0 0 2 0] *©4*. B#. fcitf. ±T£££|6)© 
WtttfflSISS- 17553 -514. CCD** 7 2 
***i5B*tt**»b. B5Ktf+B#BB. JaJLtf, 
±Tfe6*ft«>B**«iajU ftft&tttUfl4-in£ 

4- 5icmrt-6. 

[00 2 1] ^».#.tta)a54-175S4-5li, {BJx 

*LT. BB3iifcB«jfifc3i-7*f 1 ***7n-Mifi 

5- 1 JlS5-5lC§WSi-5. 

[0 0 2 2] *7*? ^*/W7n-»ta»5-175£5- 
514. B«jftttfttt4-l7SS4-5fcJ:9«lfflS*lfc 

*wBtt©«Biirofi[B £ fclttfc-f S+S - fc K4 9 * 
Utt-S. 011x14. i*a#j, Ytmii (CCD**? 2 
lc#S)LX^5>!§S. ffi»BB«>BflUUt 

[0 0 2 3] *fc, tofc#, ±*BBoWMlliJ:i» 
P>Tlw|6id'o-C»B1-6. Be, T*Bft-Ctt. 
I4T*»6±U#»L. a-#B*-Cttfe»»6;fr~, tit, 

[0 0 2 4] CCD*>7 2*0fS©*flC»»S*tfc 

[0 0 2 5] iWHt^rJ:?^. CCD*^7 2« 
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IC tfi7?iIifei4tt*L. ±T***m«>B«tt, **v€ 
it. T. ±, *, 4 fell, ttfo^mi+Z. 
[0 0 2 6] t1t % CCD** 5 2#ft£^M Sixfc 
B*lctt. B*BBlitt/J*U ±T£^(6l©Bttl4. 
tii€iv, ±. T. £, *fc»4. 

[00 2 7] CCD*y?2#±'JMT»»Silfc««' 
left, ±#BBtttt*U T*BBHtf*U 85 

[0028] CCD**?2#T'»WWtol!MZ*& 
10 Ktt, ±#BBli»*U T*BBtttfc*U *fc. B 

[00 29] CCD**7 2a«£~W»lbSi'lfc»fr 
ICI4. B*, ±*. T*BBtt4T*^Bi) 
U &WMWi*6*U *#B»tt*M>+*. 

[0030] CCD*^7 2*»t^WBft*iifc»ft 
ttt, fidf. JUtf, T*B»tt£tiMMi 
U *fc, £#Bftli«'M., fc#B«tttt*1-*. 

[00 3 1] CCD**?2#±Ha]«2$ii;ft:B£ (C 
CD*^7 20UyX7j5Jt^ % £fc. *^T^»i)i- 
20 5i5lcHB*iifcB^) ICI4, tt#Bft. £*Bft. 

feMBtli^TTNIBt. ±*B«i 
T*B«ttitk:±^B«-i-6. 

[00 32] CCD*^7 2*5T^0lsSitfc»^' (C 
CD*>7 2<O^V^5T^. ifc. *»^±^»frf 
5J:7liBB*iifc»^) Ktt, mMfa 4^Bffe, 

[0 0 3 3] CCD*^9 2^fe^®B$itfc#S- (C 
CD*7 t 7 2 4r±A^£/c<i^lC. CCD*>72(DU- 
30 *fc, **#*'NBIW-6J:5tBteSii 

fcB*) lift. B*ffi«, ±*B«, fciU 1 . T^WSi 
l4±T*-»«it. fe^ii«tt*r*ii«i4tfeicfe^ 

[00 34] CCD*^72i^BB5itfc»S' (C 
CD*^7 2t±A»fiI.fc«^U, CCD*/72(7)U 
xxaifi/v, Jfc. ***fe'MWar*-5J:5KBti*ii 
fcB*) Ktt, B*BB. ±*BB, fc«tt5, T*iS» 
I4£T£NMI>U fe*BBt**BB(Jfct)lc^» 

40 [00 3 5] CCD*^7 2^<0jtB«r^<i LTS 

IC ***SBtt*BUBB*iifc«*) fctt. B*B 
«I4. (Btt*l*l) ICBBL. ±Ttt© 

BBI4, tix^ii, 4. ±. *fcl4. T*l6)lc»ij 

[0 0 3 6] CCD#-*7 2#*rojfcM&tti.fci 

LT*IC|Hlte$nfciS^ (CCD*pt7 2«ra5*^a 
fcB^l-, *ffcWtt#|S)fc:®e*itfc»£) 1-14. B3 
^Blft«. £*(6J (S"Mi*B) KHBL, ±T 
50 fe*(Diifft(4. til^il. 4. T, 4fcl4. ±*|S) 
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[0037J @6ic/T-r«t?/i, 

timWlXtHtCCDii/J 2 <»mi (tfcli, 0(E) 
LT*Jt>, &*7"7V#/l'7n-8tii8B5-l7j£5- 

5 ^e>ttl*$ix5»»*o»ft*ifii t znf-^b * 
l^tScirJciD, CCD*^7 2<o»fi (tfcrt, 
SO #«*«*+6. flirt, «r»©J:$fc, ffijSrlB 

T, ±, £, Sfctt, £~fcttLTV>a»£ (B6©$ 
lfTlK*W&+3»£) fcl*. CCD*^7 2«^ 

10 0 3 8] j^O&tajgttlc&vtm ±T 
4 ftwRftSt l - 1 75H 1 - 4 fcKiT 5 J: 5 

*Btfe, ±jW*tf>«#a«£#|t(]'N|M» ©B»««oA» 20 

I0 03 9J -eCT*, flitf, J:7JiIfSffl©K«&l- 
li:S*i(«<0SWMl-3W2oSrS!;i75i < £~tf> 
4-~©[3lB©l29Jtt. £*B«M<ft*1-aa» 

©WfMtoi*~*>0t50>IBWtt. ttmmW'htZ 

10 0 4 0] Zt\b<r>fcti%.l - 1 7jHl -4(0 

i?ir-rjxrt«t^„ 30 
[004 illi KJMIHlelMttr*. K**7 
iclftlWoiVllirtto^ flirt, 07(c,tH-J:5 
lc /<- y ^ 3 v f a - 9 ffl v > x % &t z z 1 1> plttre 

[ o o 4 2 ] la 7 1±, **^ro<fi<oHJfirojg|8<ofl»fi!EW 

=>y fa— * 2 Oli, CPU (Central Processing Uni 

t) 20-1 mi ©tt«*a, * 2 «hk 

£.ttiiJ#a, Biti^S) . ROM (Read Only Memory) 
2 0-2, R AM (Random Access Memory) 20-3, 40 
IF (Interface) 2 0-4, fciU, /<*2 0-5(C 
i.*)mf££hT^Z. I F 2 0 — 4|CrtCCD*y 5 2 
JJ 5 S«*ftT*$»>. CCD*>7 2<D«f|7flCrt, B2IC 

1 <o t wmofcto®. i #eg s fi-o * $. 

[0043] CPU20-ltt, *fflft**£trrsJ: 
fcfcfc. aio*W*MIW*J:?lc**ii-«»a. R 
OM2 0-2JCI4, ftffrB^M^'-J'&JWmrt 
StvCVS, RAM 2 0 - 3(i, CPU2 0- 1#£« 

SICfcStlTPS. IF20-4I*, CCD 50 
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**7 2a»felMj*ix$IIHWIW<f 
*l/CB*i4tfi:fct>fc, /<-y7vu=>>f»-*2 0 
ICfcV'-CaeSftfcCCD** ? 2<0#ft7j|6]©*l]££ 
*£ffl7J-t5. /<*20-5tt, CPU20-1. RO 
M20-2, RAM20-3, Jd.£U\ IF20-4£ 

[0 0 4 4] B8tt. H7fc*+ISIiw>»ttW8v*-C* 
tT$ixi«iSro-fl«rSiW-r2)7D-^+- hT-fcS. 

WCPU20-ltt, Xry-fS lWBHT. CCD* 

**|6lWiS« (H5*ffi) «*H1+*. 
[00 4 5] *r77*S2-C*l±, CPU2 0-1I4, * 

A (flirt, »«i-*»»fcit'<TWWt« 5 *#<*fl2 

[004 6] Xr77*S3-C'rt, CPU20-K4, ffj 
EOfeSfcfcV'TtfttHeFtlTR AM 2 0 - 3 {C*&4ft$lx 

[00 4 7] ^7 77"S4T'I1 C PU 2 0-1 14, * 
T •/ 7"S 3 izto^xmH$txti&Mt&<D*7'Tj f) ^7 
o-t. 16lc;jrfr-7'/i'i:£!S£U CCD*^7 
2<D&W> **lfc*lU**|irt5. *L 

T, *l]$$ixrc^*rt, I F2 0-4*7>LTttl73$n 

[0048] 7>T77*S5IC^V^Trt, CPU20-1 

rt. w±<ows (^ry7*s 2<D«ia) -cttai$nfc«f 

[0049] «<Xry7"S6T'll. CPU20-1 
rt, «a*»T1--5* , S3J»t«S1-5. ^rw^«, 
Sr«t^-fa (NO) tW^Lfc*^lt^7-y7'S HC^ 

)^71-5 (YES) t«jeLfc«^lctt, «a«r»T1" 
4 (i^ K) . 

[0050] « J:©i 5 <cn t&nmmz <th.rt. /<- y 

a y M a - 9 2 0 i: 7 7 h ■? ^ 7 1 <Dffl^*>frlC 
CCD7>^7 2(0#»iA-[fil«rfB*IC, L^tlSt 

[00 5 1] f£H. W±©H!6<0^!il-fc^TI±, 4ft 
©Slt^ 1 - 1 1 - 4 5rC CD*> 7 2©8«J77<CE 
gt5«t?^Lt^, flilf, S««H-l©*«-Efi 
LT, C*v«rCCD#;<7 2©7ttt£*<kil,T|a]e$ 
«, #S©ttH (KWa 1 - 1 Tbm 1 - 4 lc*t£1-3<4 
g) «cgW«^»tfc»^©ii{fe4rttmt5«t5JcL 



(6) 



[005 2] 

•town* HJWtSiMe < k tft&o i *(Sjo)tt J: 9 Bfe 
«*«r£l*U *«*lRlH»lt!t6B«l«*«:ttfflU. 

*f6j«r]E8iic ifrbmtm-tz z t frmttts. id 

[BBOfBWftttH] 

[0 1 ] **W»-*«0»«»«riE««:*+^n v * 
0T'*>?>„ 

[HZ] HlK*-fR««l-l»Ml-4©BB«MB 
[03] HllC*-rR*t*l-l7Hei-4iCCD* 
[04] ElllC^i-g#tai-l7!)Ml-4i:CCD* 
5. 20 

las] 0iic^-rnisojgsiicj;«)a«$nfciB«(o* 
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[06] 01IC/TrfCCD*^7 2<D»ft*(6) 
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